Replication details for How Do We Know What We Know? Learning from Monte Carlo Simulations
Authors: Vincent Hopkins, Ali Kagalwala, Andrew Q. Philips, Mark Pickup, and Guy D. Whitten

Software details:

R:
R version: 4.1.1 (2021-08-10) -- "Kick Things"
R studio version: 1.4.1717
Operating system: Windows 10 Enterprise (x86_64-w64-mingw32/x64 (64-bit)).
Files: sluggish.R, standard.R, WilkinsReplications.R, overconfidence-tester.R

Stata:
Version: Stata/MP 17.0 for Mac (Apple Silicon), Stata/MP 17.0 for Mac (Apple Silicon)
Operating system: macOS Monterey, Version 12.0.1
Files: literature_coding.do, article_coding.dta

A. Wilkins (2018):
File: WilkinsReplications.R
Output: WilkinsRep.pdf (Figure 8 in the online appendix).
Packages: matrixStats_0.57.0, robustbase_0.93-6, cowplot_1.1.1, tidyverse_1.3.0.
Notes: Working directory needs to be set on line 12.

B. Clark and Linzer (2015) Sluggish Case:
File: sluggish.R
Output: 2000sims_sluggish.RData, CL_RMSE_Sluggish.pdf (Figure 4 in main paper),
	 CL_Coverage_Sluggish.pdf (Figure 5 in main paper), CL_Power_Sluggish.pdf (Figure 6 in main paper), 
	 CL_Bias_Sluggish.pdf (Figure 7 in main paper), CL_SD_Sluggish.pdf (Figure 8 in main paper)
	 CL_Optimism_Sluggish.pdf (Figure 9 in main paper).
Packages: lme4_1.1-25, MASS_7.3-53, matrixStats_0.57.0
Notes: Working directory needs to be set on line 11.

C. Clark and Linzer (2015) Standard Case:
File: standard.R
Output: 2000sims_standard.RData, CL_RMSE_Standard.pdf (Figure 2 in Appendix D),
	 CL_Coverage_Standard.pdf (Figure 3 in Appendix D), CL_Power_Standard.pdf (Figure 4 in Appendix D), 
	 CL_Bias_Standard.pdf (Figure 5 in Appendix D, CL_SD_Standard.pdf (Figure 6 in Appendix D)
	 CL_Optimism_Standard.pdf (Figure 7 in Appendix D).
Packages: lme4_1.1-25, MASS_7.3-53, matrixStats_0.57.0
Notes: Working directory needs to be set on line 11.

D. Table 1 in Appendix A:
File: overconfidence-tester.R
Notes: Output is displayed in R

E. Literature review coding:
Files: literature_coding.do, article_coding.dta
Packages: misschk
Notes: 1. Working directory needs to be set on line 9. 
       2. This is for Table 1 in the mansucript, Figure 1 in Appendix C, Table 2 in Appendix C,
       and in-text numbers on p.7 of Appendix C. Output is displayed in Stata.

F. Hanmer and Kalkan (2013):
Files: HanmerKalkan_Rep.do, HanmerKalkan_Sims.do
Output: hanmerkalkan_results.dta, hanmerkalkan_results_tidy.dta, 
	HanmerKalkan_Appendix_Model1.dta (Table 3, Appendix F), 
	HanmerKalkan_Appendix_Model2.dta (Table 4, Appendix F), 
	HanmerKalkan_Appendix_Model3.dta (Table 5, Appendix F)
Notes: 1. Only HanmerKalkan_Sims.do needs to be run and working directory needs to be set on line 3. HanmerKalkan_Rep.DO and HanmerKalkan_Sims.do need to be in the same directory.
       2. For each of the tables, the true marginal effect values are given by rows which have the 
          "Model" as "True Values" and the "Model Description" as " True Marginal Effects."       